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Abstract — A coded modulation system is considered in which 
nonbinary coded symbols are mapped directly to nonbinary 
modulation signals. It is proved that if the modulator-channel 
combination satisfies a particular symmetry condition, the code- 
word error rate performance is independent of the transmitted 
codeword. It is shown that this result holds for both linear- 
programming decoders and sum-product decoders. In particular, 
this provides a natural modulation mapping for nonbinary codes 
mapped to PSK constellations for transmission over memoryless 
channels such as AWGN channels or flat fading channels with 
AWGN. 

I. Introduction 

Low-density parity check (LDPC) codes [1], as well as 
their nonbinary counterparts [2] have been shown to ex- 
hibit excellent error-correcting performance when decoded by 
the traditional sum-product (SP) decoding algorithm. In [3], 
Feldman et al. introduced the idea of linear-programming 
(LP) decoding of LDPC codes. This was later generalized to 
nonbinary codes in [4]. 

For classical coded modulation systems, geometric unifor- 
mity [5] was identified as a symmetry condition which, if satis- 
fied, guarantees codeword error rate performance independent 
of the transmitted codeword, where maximum-likelihood (ML) 
decoding is assumed. Some recent coded modulation schemes 
with SP decoding used this symmetry condition for design 
[6]. An analagous symmetry condition was defined in [7] for 
binary codes over GF{2) with SP decoding; this was extended 
to nonbinary codes over GF{q) by invoking the concept of 
coset LDPC codes [2]. 

In this work it is shown that for the cases of LP and SP 
decoding of linear codes over rings, there exists a symmetry 
condition under which the codeword error rate performance 
is independent of the transmitted codeword (for the case of 
LP decoding this theorem generalizes [3, Theorem 6], and 
is stated in [4]). This provides a condition somewhat akin 
to geometric uniformity for state-of-the-art nonbinary coded 
modulation systems. 

II. General Framework 

We consider codes over finite rings (this includes codes 
over finite fields, but may be more general). Denote by EH 



a ring with q elements, by its additive identity, and let 
«n- = 5n\{0}. Let C = {c G : cT-F = 0} be a linear 
code defined with respect to the mx n parity-check matrix H 
over EH. Denote the set of column indices and the set of row 
indices of 7i by X = {1, 2, • • • ,n} and J' = {1, 2, • • • , m}, 

(r) 

respectively. For j e J', let Ti.) denote the j-th row of 

(c) 

Ti, and for z e X, let Til denote the z-th column. Denote 
by supp(c) the support of a vector c. For each i ^ I, let 
= supp(h|''') and for each j e J, let X,- = supp(7i^'''). 
Also let AjA = and Vj., = Ji\{i}- 

Given any c G EH", we say that parity check j G J' is 
satisfied by c if and only if 



(1) 



Ci ■ Tij^i = 

For j G i7, define the single parity check code Cj by 

Note that while the symbols of the codewords in C are indexed 
by I, the symbols of the codewords in Cj are indexed by X,. 
We define the projection mapping for parity check j E hy 

Xjic) = (ci)iei^. 

Then, given any c G EH", we may say that parity check j G J7 
is satisfied by c if and only if 



(c) G C, 



(2) 



since ([T]i and (O are equivalent. Also, we say that the vector 
c is a codeword of C, writing c G C, if and only if all parity 
checks 2 E J are satisfied by c. 

Assume that the codeword c = (ci,C2,--- ,c„) G C has 
been transmitted over a g-ary input memoryless channel, and a 
corrupted word y = (yi, j/2, • • • , 2/n) G 5]" has been received. 
Here E denotes the set of channel output symbols; we assume 
that this set either has finite cardinality, or is equal to E' 
or C' for some integer I > 1. In practice, this channel may 
represent the combination of modulator and physical channel. 
It is assumed hereafter that all information words are equally 



probable, and so all codewords are transmitted with equal 
probability. 

Next we set up some definitions and notation. We define 
the mapping 



and 



9-1 r- 189-1 



by 



C : SKi-^ {0,l}'?-i C 



i{a) = x = {x^'^^)^(=<n- 



such that, for each 7 G $K , 

3.(7) = / 1 if 7 = a 
[ otherwise. 

We note that the mapping ^ is one-to-one, and its image is the 
set of binary vectors of length q — 1 with Hamming weight 
or 1. Building on this, we also define 



H : 5n" {0, C 



according to 

3(C) = (l(ci) I ^(C2) I ••• ||(c„)) 

We note that H is also one-to-one. 

Now, for vectors / G M(9-i)n^ adopt the notation 



where 



In particular, we define A e M^'' by setting, for each i e I, 

a e m-, 

and p{yi\ci) denotes the channel output probability (density) 
conditioned on the channel input. 

Also, we may use this notation to write the inverse of H as 

3-\/) = (r'(/i),r'(/2),---,r'(/j) 

III. Decoding Algorithms 

A. Linear-Programming Decoder 

The linear-programming (LP) decoder of [4] operates as 
follows. The linear program described here is equivalent to 
that given in [4]; however, some changes of notation have 
been made in order to facilitate the proof to come in section 
IIVI The variables of the LP are 

/^"^ for each i G J, a G fH" 

and 

Wj h for each j G J', b G Cj 



and the constraints are 



and 



bee, 



(3) 
(4) 



yjej, Vielj, Vaem- 

f{a) 



(5) 



The set of points (/, w) which satisfy (O]!-® form a polytope 
denoted by Q. The cost function to be minimized over this 
polytope is F{f) = Xf^, and the minimizer is denoted by /. 
If / G {0, l}(9-i)", the output is the codeword H~^(/) (it is 
proved in [4] that this must be the maximum-likelihood code- 
word). Otherwise, the decoder outputs a 'decoding failure'. 

B. Sum-Product Decoder 

The sum-product (SP) decoder operates as follows. Note 
that in practice, computations are usually carried out in the 
log-domain, but this does not affect our analysis. 

Initializing 



and 



mi (a) = p{yi\a) Vz G X, Va G (6) 



m"f{a) = l yj eJ,yieJj,yaem (7) 



N iterations of fully parallel SP decoding may be represented 
by the following recursive formulas. For each k = 1, 2, • • • TV, 

D,k-1, 



for each j G i G I,, a G $H, and 



-Li 



{a) 



(8) 



D,k/ \ 

m-l [a) 



n m^^f (dO (9) 



E 

for each j G J^, ? G X/, a G 9^. Finally, decisions are made 



via 



gi{a) = mi (a) • 



mf:^(a) gX, Va G 



(10) 



and 



ft-i = argmax{(7i(Q;)} Vi G X (11) 

The output of the decoder is then h — {hi, h2, - ■ ■ ,hn)- 

IV. Main Result 

Symmetry Condition. 

For each /? G 9^, there exists a bijection 

Tp : E >■ E 

such that the channel output probability (density) conditioned 
on the channel input satisfies 



piy\a) = p{Tp{y)\a - 13) 



(12) 



for all y G S, a G 9\. When S is equal to MJ or C' for ^ > 1, 
the mapping Tp is assumed to be isometric with respect to 
Euclidean distance in S, for every /? G 91. 

In the following, codeword error is defined as the event 
where the decoder output is not equal to the transmitted 
codeword. 
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Theorem 4.1: Under the stated symmetry condition, the 
probability of codeword error is independent of the transmitted 
codeword 

(a) under linear-programming decoding 

(b) under sum-product decoding. 

Proof: We shall prove the theorem for the case where E 
has infinite cardinality; the case of discrete S may be handled 
similarly. Fix some codeword c e C, c 7^ 0. We wish to prove 
that 

Pr(Err | c) = Pr(Err | 0) 

where Pr(Err | c) denotes the probability of codeword error 
given that the codeword c was transmitted. 
Now 

Pr(Err | c) = Pr(y G S(c) | c) 

where B{c) is the set of all receive words which may cause 
codeword error, given that c was transmitted. Also 



Pr(Err | 0) ^ Pr(y G S(0) | 0) 



So we write 



Pr(Err \ c) = p{y\c) 

JyeB(c) 



dy 



and 



Pr(Err|0)= / p{y\0)dy 

JyeB{0) 



(13) 



(14) 



Now, setting a = (3 in the symmetry condition (fT2] i yields 

p{y\P) ^ p{Tf,{y)\0) (15) 

for any ?/ e S, /3 e 91. 

We now define y = G{y) as follows. For every i G X, if 
c^= f3 em then 

lli = Tpivi) 

We note that G is a bijection from the set S" to itself, and 
that if y,z e S" and a ^ /3 e m then 



and so 



lly* - ZtW^ = \\Tfj{yi) - Tp{zi)\\ 



\G{y)-G{z)r = \\y-z\, 



i.e. G is isometric with respect to Euclidean distance in S". 

We prove that the integral (fT3] l may be transformed to (fl4] i 
via the substitution y = G{y). First, we have 

p{y\c) = n^'^^/^l'^') 

= n n p^y^\p) 
= n n piMy^m 
= n n p(y^\^^ 

iei 

= piy\o) 



Since G is isometric with respect to Euclidean distance in S", 
it follows that the Jacobian determinant of the transformation 
is equal to unity. Therefore, to complete the proof, we need 
only show that 

y e B{c) if and only if y G B{0) 

We prove this separately for the two cases of linear- 
programming and sum-product decoding. 

(a) Under linear-programming decoding: 

Here 

B(c) = {yeS" : 3{f ,w) e QJ ^ S{c) 

with A/^ < \S{cf} 
Recall that here A is a function of y via 



log /'p(2/dO) 



.piy^\o^). 

foT i e I, a e Also 

i?(0) = {yeS" : 3(/»e Q,/^H(0) 



(16) 



with A/^ < AH(0)^} 



Here A is a function of y via 



= log f'4« 



(17) 



for i e T, a E $H^. We begin by relating the elements of A 
(defined by ( fTSI l) to the elements of A (defined by (fTTIi). Let 
i G I, a E . Suppose ct — (3 E d\. We then have 



A 



This yields 



= log 
= log 
= log 

A, 



p{y^\Q) 
p{yi\a) 

p{rp{yi)\-(3) 
Piri3iyi)\a - (3) 

pim\-P) 

p{yi\a - (3) 



a(") = 



(a) 



if /3 = 
if a = /? 



Next, for any point {f,w) E Q we define a new point 
(/, w) as follows. For alH e X, a e 5H~, if Ci = (3 E m then 



1 - E.eiK- if a = -(3 



(a+/3) 



Otherwise. 



(18) 



For all j E J , r E Cj we define 



where 



b = r + Xj{c) 



Next we prove that for every {f,w) E Q, the new point 
{f,w) lies in Q and thus is a feasible solution for the LP. 
Constraints ^ and (|4|i obviously hold from the definition of 



3 



w. To verify (|5]), we let j E J', i £ Tj and a e . We also 
let Ci = (3 E yi. We now check two cases: 

. Ifa==-/3, 

fV = 1- E 

= Y.'^^^b- ""i^b 

beCj 7eK- beCj, &i=7 



If /3 7^ 0, 



7(a) _ Aa+13) _ 

beCj, bi=a+l3 

Therefore {f,w) E Q, i.e. {f,w) is a feasible solution for 
the LP. We write {f,w) — L{f,w). We also note that the 
mapping i is a bijection from Q to itself; this is easily shown 
by verifying the inverse 

^ I 1 - E-yGK- f^''^ if « = /? ^^^^ 

* 1 /j^" Otherwise 

for all i E T, a E 91^, and 



where 



Wj b — Wj r 



r = b Xj{c) 



for all j E J,bE Cj. 

We now prove that for every {f,w) E Q, {fjW) — 
L{f, w) satisfies 

A/^ - \S{cf = \f - \S{Of (20) 
We achieve this by proving 

Kfl - K^ic^f - A,/f - A,C(0)^ (21) 

for every i E I. We may then obtain ( |20| | by summing (l2Tl i 
over i E I. Let = /3 S We consider two cases: 

. If /3 = 0, (EB becomes 

which holds since in this case a|"^ = A^"^ and fj^""^ = 
/f"' for all a e 91-. 



(7)^(7) _ ^iP) 



7#/3 



= E 



(a) ,(a+/3) 




= E >ri 



= A,/f - A.I(O)^ 

where we have made use of the substitution a — j — P in the 
third line. Therefore (l2Tl i holds, proving (l20l i. 

Finally, we note that it is easy to show, using (fTSl l and ( fT9] l, 
that / = H(c) if and only if / = H(0). 

Putting together these results, we may make the following 
statement. Suppose we are given y,y E S" with y ~ G{y). 
Then the point (/, w) E Q satisfies / ^ 3(c) and A/^ < 

AH(c)-^ if and only if the point {f,w) = L(f,w) E Q 

f ^ 

satisfies / ^ 3(0) and A/ < AH(0)^. This statement, along 
with the fact that both G and L are bijective, proves that 

y E B{c) if and only if y G 5(0) 

This completes the proof of the theorem for the case of LP 
decoding. 

(b) Under Sum-Product Decoding: 

Recall that all decoder variables appearing in equations (|6]l- 
(fTTT i are functions of y via For any such variable x, let x 
denote the corresponding variable with y as input. Then we 
have, for alH e X, a G £H, where — /3, 

mj(a) ^p{y,\a) = p{Tp{y^)\a - (3) 
= p{yi\a - Cj) = fhi{a - 



Next we prove by induction that for all fc = 0, 1, • • • A^, 



[a) = m ,' (a - c,) 



(22) 



for all j E J^, i E 2j, a E 'iR. This result holds for the base 
case fc = because from ^ 

mff{a) - mffia) = 1 V j G J, Vi G X,, Va G 

Assuming that (l22T l holds for some fc = r — 1 G {0, 1, • • • iV — 
1} (and for all j E J, i Elj, a E SK), we obtain by dUl 



m ■ ; (a) — m, 



(«)• n 



D.r-l 



(a) 



= ; (a - Cj) 



4 



for all j J,i(^ Tj, a G 5H. So, by 



E 



E 

- D.r / \ 



n 



for all j e i/, i e Xj, a e EH, where we have made the 
substitution bi — di — q for each / e Tj, and used the fact 
that J2ieA '^I'^jJ ~ "CiUj i since c e C. It follows by the 
principle of induction that ( l22b holds for every k = ■ ■ ■ N , 
j e J, i elj, a Therefore by (0 

g,{a) = TOi(a) • J]^ TOj^,'^(a) 

= rhi{a- Cj) • J]^ j' {a - 

= g.i{a-Ci) 

for all i G X, a G 9^, and so by (fTTI) . hi = hi — Ci for all 
i E T. Therefore /i 7^ c if and only if ft. ^ 0. We conclude 
that 

y € B{c) if and only if y G 5(0) 

This completes the proof of the theorem for the case of SP 
decoding. It is trivial to see that this proof generalizes to the 
case of optional early exit of the iterative loop on successful 
completion of a syndrome check. ■ 

V. Application: Nonbinary Codes Mapped to PSK 

MODULATION 

While this theorem may be shown to apply to other 
coded modulation systems such as nonbinary coded orthogonal 
modulation over memoryless channels and nonbinary coding 
over the discrete memoryless q-ary symmetric channel, we 
focus in this paper on the practical application of nonbinary 
codes mapped directly to PSK symbols and transmitted over 
a memoryless channel. Here S = C, and denoting the ring 
elements by £H = {gq, ai, • • • , aq_i}, the modulation mapping 
may be written without loss of generality as 



such that 



M : m> 



M{ak) = exp 



(23) 



for fc = 0, 1, • • • , 5 — 1 (here i — \/^). Here ( fTSl) . together 
with the rotational symmetry of the g-ary PSK constellation, 
motivates us to define, for every /3 = at G IK, 



Tp{x) = exp 



Next, we also impose the condition that under addition 
is a cyclic group. To see why we impose this condition, let 
a = a/j G 9^ and /3 = a/ G EH. By the symmetry condition we 
must have 

P{yi\a + /?) = p{Ta+fj{yi)\Q) 

and also 

p{yi\a + P)= p{Tii{yi)\a) = p{Ta{Tp{y{))\Q) 

In order to equate these two expressions, we impose the 
condition Ta+f){x) = Ta{Tp{x)) for all a; G C, a, /3 G EH. 
Letting a + (3 = ap E D\, and using (l24l) yields 

/-i2TTk\ f -i2ttI\ 
exp • exp = exp 

\ q J \ 1 J 
and thus p = k + I mod q. 
Therefore, we must have 



'l2lTp 



ak + ai — a(k+i mod q) 



(25) 



Vx G 



(24) 



for all ak , a; G EH. This implies that EH, under addition, is a 
cyclic group. 

It is easy to check that the condition that EH under addition 
is cyclic, encapsulated by dZSl ). along with the modulation 
mapping ( l23T l. satisfies the symmetry condition, where the 
appropriate mappings Tp are given by (l24l i. This means that 
codeword-independent performance is guaranteed for such 
systems using nonbinary codes with PSK modulation. This 
applies to AWGN, flat fading wireless channels, and OFDM 
systems transmitting over frequency selective channels with 
sufficiently long cyclic prefix. 
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